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Abstract. The set of Nash equilibria of a finite game is the set of nonnega- 
tive solutions to a system of polynomial equations. In this survey article we 
describe how to construct certain special games and explain how to find all 
the complex roots of the corresponding polynomial systems, including all the 
Nash equilibria. We then explain how to find all the complex roots of the 
polynomial systems for arbitrary generic games, by polyhedral homotopy con- 
tinuation starting from the solutions to the specially constructed games. We 
describe the use of Grobncr bases to solve these polynomial systems and to 
learn geometric information about how the solution set varies with the payoff 
functions. Finally, we review the use of the Gambit software package to find 
all Nash equilibria of a finite game. 



1. Introduction 

The set of Nash equilibria of a finite game is the set of nonncgativc solutions to 
a system of polynomial equations. In this article we introduce this point of view 
and survey the computational methods for finding Nash equilibria using polynomial 
algebra which are available to game theorists today. We give examples which we 
hope will enable game theorists to find all Nash equilibria of games of relatively 
larger formats. When we know only a subset of the Nash equilibria of a game, we 
have a rather shaky foundation for making predictions about what could happen 
in repeated trials of the game, since play may converge toward a Nash equilibrium 
which is not in the subset. Knowing all the Nash equilibria of a game will help us 
to make more principled predictions. 

2. The System of Polynomial Equations 

A monomial in n variables x\, . . . , x n is an expression of the form xf 1 . . . x^ 1 for 
some nonncgativc integers di, . . . , d n . It is squarefree if di < 1 for all i. The degree 
in Xi of this monomial is di, and its total degree is di- The product of two 

monomials xf 1 . . . x^" and x^ 1 . . . x^ is xf 1+ei . . . x%" +e ™ . 

A polynomial in n variables x%, . . . ,x n with coefficients in a field K is a finite 
sum of terms. Each term is of the form cm for some c £ K and some monomial 
m in xi, . . . , x n . The set of polynomials in n variables is a vector space whose 
basis is the set of monomials in n variables. Since we can also multiply monomials 
together, we can extend this multiplication to define a product on the space of 
polynomials, using commutativity, associativity, and distributivity. This makes the 
set of polynomials in n variables with coefficients in K into a commutative ring, 
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and the study of such objects is the subject of commutative algebra. A field is a 
commutative ring in which every nonzero element has a multiplicative inverse. 

We can evaluate a polynomial / = X) ^...d^xf 1 ■ ■ • x^ 1 at a point (a\, . . . , a n ) G 
K n by substituting 01, . . . , a n for the variables x\, . . . ,x n respectively, obtaining an 
expression c < j 1 ...d I1 a^ 1 • • • a^™ and carrying out all the multiplications and addi- 
tions in the field K. We denote the resulting element of K as f(ai, . . . , a n ). 

A polynomial equation is an expression f = g for some polynomials / and g. 
A point a G K n satisfies this equation if /(a) = g(a). Since this is equivalent to 
f(a) — g(a) = 0, we can always write a polynomial equation as p = for some 
polynomial p. A point satisfying this equation is called a root of p. A polynomial 
in one variable with coefficients in K need not have any roots in K. But there is 
always a field containing K, called the algebraic closure K of K , such that every 
nonconstant univariate polynomial with coefficients in K has a root in K. The field 
of complex numbers is the algebraic closure of the field of real numbers. 

The multiplicity of a root of a polynomial denotes how many linear factors of 
that polynomial vanish at that root. (Every polynomial factorizes into linear factors 
over the algebraic closure of its coefficient field.) For example, the multiplicity of 
the root 1 of the polynomial (x — l) 2 is 2. A polynomial equation of degree d in one 
variable has d complex roots (counted with multiplicity); this is the Fundamental 
Theorem of Algebra. 

A system of polynomial equations in n variables over K is a finite set of polyno- 
mial equations in n variables over K, and a point in K n satisfies, or is a root of, 
this system if it satisfies all the constituent equations. The study of solution sets 
of polynomial systems is called algebraic geometry. Recent years have seen a re- 
naissance in computational algebraic geometry] the interested reader is referred for 
example to [4j. The subsequent volume [5] contains more information, particularly 
about finding the roots of polynomial systems. The book [24| surveys techniques for 
solving polynomial systems and includes a chapter on finding Nash equilibria. [8] 
is a recent summary of the state of the art of solving polynomial systems. |23j ex- 
plains numerical algebraic geometry and is written for a general technical audience 
(rather than a mathematical one). 

We now fix the game-theoretic notation we shall use. The concepts we describe 
here can be found in a standard game theory text such as |2fj . A normal form 
game with a finite number of players, each with a finite number of pure strategies, 
is specified as follows. The set of players is denoted as I = {1 , . . . , N}. Associated 
to the players are finite disjoint sets of pure strategies Si, ... , Sn- We require that 
| Si | > 2 for each i. Write S = Yiiei &i f° r the set of pure strategy profiles. For 
each i let di = \S%\ — f , and write the set Si as {-Sio, ■ ■ ■ , s^}. So a pure strategy 
profile s G S can be written as s = (s±, . . . , sjv), where for each i, we have Si = s,-j 
for some j with < j < d t . Let D = (|Si| - 1). So N = D + N. 

The set Ej of mixed strategies of player i is the set of all functions <Xj : Si — * [0, 1] 
with YljLo a i( s ij) = 1- Write E = Y\ ieI Ej for the set of strategy profiles. Write 
E_; = nje/-{j} ^j- We will call an element of E_i a (— i)-strategy profile. Write 
S-i = rijez-m Sj- We will call an element of S-i a pure (— i)-strategy profile. 
Write cr_i for the image of a G E under the projection 7r_i onto E_j. Write ov, = 
Oiisij) for j = 0, . . . , di. A game format is a specification of a number of players 
TV and the number of pure strategies each player has, specified by the numbers 
d\, . . . , dj\f. Without loss of generality we can require that d\ > di > ■ ■ ■ > d^. 
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The game is specified by describing the payoff function u% : S — > R for each player. 
The ith player's expected payoff from a strategy profile a is given by multilinearity 

as 

u i( a ) = ^u i (s)a 1 (si) ■ ■ -a N (s N ). 

sGS 

By abuse of notation, write Ui(ai, a-i) for the zth player's expected payoff from the 
strategy a whose ith component is oi and whose other components are defined by 
TT-i{cr) = a-i. 

A mixed strategy a* of player i is a best response to the (— i)-strategy profile 
o-i if for every mixed strategy <Ji of player i, we have Ui{a* , a-i) > Uj(erj, a-i). A 
strategy profile a* is a Nash equilibrium if for each player i, the mixed strategy a* 
is a best response to a*_ ti . 

We can rewrite the expected payoff to player i as follows: 

u l (a l ,a-. l ) = ^Ujjsj, s-j)ax(si) ■ ■ ■ffjy(.Sjv) 

= ^ ^ u i (s ll s- i )a 1 (si) ■ ■ -a N (s N ) 

= a i( s i) X] u i( s *> s-i) 17 ^!) ■ ■ ■ Vi-i{si-i)a l+1 (s i+1 ) ■ ■ ■ a N (s 

di 

= Uiisij^-i). 

We see that the function Ui(sij , a-i) is a polynomial with real-valued coefficients. 
For each s-i — {s\j 1 , S(j_i) J - i _ 1 , S(i+i)j i+1 , ■ ■ • , SNj N ) £ S-i, the contribution to 
Ui(sij,a-i) from the outcome (sy, s_i) is the squarefree monomial 

(which may be interpreted as the conditional probability that the outcome will 
occur, given that player i chooses pure strategy sy), multiplied by the real- valued 
coefficient Ui{sij , s_;) (the payoff to player i for that outcome). The following 
proposition describes the system of polynomial equations whose nonnegative solu- 
tions give the Nash equilibria. 

Proposition 1. The sequence of real numbers 

(uio, . . . , o\di j • • • j ""ato , • • • , a Nd N ) 

constitutes a Nash equilibrium if and only if for some sequence of real numbers 

(vw, ■ ■ ■ ,vid ± , ■ ■ ■ ,v N0 , . . . ,v NdN ), 

the a^ 's and Vij 's satisfy the following system (*) of2(D + N) polynomial equations 
in 2(D + N) unknowns: 

Ui(sij a-i) + = Ui(sio,a-i) +v i0 for each i e I and for j = 1, . . . , di, 

°~ij v ij = f or eac h i £ I and for j = 0, . . . , di, 

di 

aij = 1 for each i £ I, 

3=0 

and all the cry 's and Vij 's are nonnegative. 
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Proof. =>■: Suppose a is a Nash equilibrium. Certainly all the ct^ 's are nonnegative 
and Y)j—Q erg = 1 for each i £ I. For each i G I and j = 0, . . . , d,-, let = 
Ui(cr) — Ui(sjj, cr_j). Then > since cr^ is a best response to er_i. The quantities 
Ui(sij, cr_i) + are all equal to Ui(cr) and hence to each other. 

It remains to show that UijVij = 0. If Oij = 1, then Ui{a) = Ui(sy, a-i) and 
i>ij = 0, so we may assume Oij < 1. Define a* by cr* 7 = and 



for I j 



Clearly a* t > 0, and 



Then 



Ui(sij,o--i) 



1 , . a. 



Ui(a) - Ui(sij,a-i) 



1 — 0~ij ' 1 — f7y 



Ui(o-) + - — - — (ui(cr) - Ui(sij,a-i)) 

1 — (7^ 

Ui(<7) 



1 - Oij ' 



so o~ijVij = since <7i is a best response to cr_j. 

4=: Suppose the 's and 's are nonnegative and satisfy the polynomial system. 
Let a be the strategy profile defined by o~i(sij) = o~ij . Fix a player i and suppose a\ 
is a mixed strategy of player i. Then X^Lo ~ a n ) = ^, so there must be some 
j for which cr- — Ujj > 0. Without loss of generality suppose that a' iQ — <x;o > 0. 
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di 
3=0 

^2(<Jij - a'ij) (ui(sij,(T-i) - Ui(s i0 , a-i)) 
j=o 

di 

^T,(vij - <r'ij)(vio - Vij) 
i=i 

di 

((1 - CTio) - (1 - £7- )) V i0 + ^ VijVij 

3=1 

di 

Thus a is a best response to a-i for each i, and a is a Nash equilibrium. □ 

We call the Uy's complementary slack variables. If «y > 0, that is, the payoff 
Ui(sij,o~—i) to player i for strategy is strictly less than the equilibrium payoff 
Ui{o~), then = 0, that is strategy s,j cannot be a component of the mixed 
strategy of player i. Conversely, if > (which must hold for some j), then the 
payoff to player i of pure strategy Sij must equal the equilibrium payoff. 

3. What Kind of Geometric Object Is The Set of Nash Equilibria? 

Thus the set of Nash equilibria is the set of real solutions to a system of polynomial 
equations and inequalities with real coefficients. Inequalities can only be defined 
over ordered sets; the field of complex numbers, for example, is not ordered. A set 
of real points given by a system of polynomial equations and inequalities is called 
a semialgebraic variety, and the special case when the system does not involve 
inequalities is called a real algebraic variety. Thus the set of Nash equilibria of 
a game is a semialgebraic variety. Real algebraic geometry is the study of real 
algebraic varieties and semialgebraic varieties. This area of algebraic geometry has 
many features of special interest (quite apart from its usefulness in applications). 
(For example, over the real numbers any system of equations /i = 0, ...,/„ = is 
equivalent to a single equation /f + /| + • • • + = 0.) It so happens that Nash's 
contribution to real algebraic geometry was seminal, although he did not relate it 
to game theory. The two main references for real algebraic geometry are [3] and 

DP- 

The set of points in the plane with x > and y > is the nonnegativc quadrant, 
the set of points in 3-space with x > 0, y > 0, and z > is the nonnegativc octant, 
and similarly the set of points in R™ all of whose coordinates are nonncgative is 
the nonnegativc orthant. In this case, the inequalities state simply that we are 
interested in those solutions to the polynomial system which lie in the nonnegativc 
orthant. 

In the system (*) of polynomial equations, we can substitute each Uij with pf^ and 
each with r?j , where the pij 's and the 's are new unknowns. This induces a new 



Then 

Ui(a) - Ui(o-' i: a-i) = 
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system (**) of polynomial equations in the pij's and r^-'s. (For example, Pijffj = 0, 
Xy=o Pij = ^ an< ^ so f° r th-) Each real- valued solution to (**) corresponds to a Nash 
equilibrium, since cry = p?^ and = r^- automatically satisfy the nonnegativity 
constraints. However, there may be up to 2 D+N solutions to (**) for each Nash 
equilibrium, since if cry is positive we can set each equal to either its positive 
or negative square root, and similarly for v^j. 

A transformation of a set X is a 1-1 correspondence of X with itself. A group 
of transformations is a set G of transformations such that for each transformation 
in G, its inverse transformation is also in G, and for each pair of transformations 
in G, their composition is also in G. We consider the composition of two transfor- 
mations in G to be their product in G. (Note that this product is not necessarily 
commutative.) We say that the group of transformations acts on the set X which 
it transforms. Given any set T of transformations {gi, . . . ,g n }, we can form the 
group generated by the generators g\,..., g n by taking all products of elements of 
T and their inverses. An orbit of the group action is the set of images of a single 
point in X under all the transformations in G. Every point in an orbit is the image 
of every other point under some transformation in G. To form the quotient of X 
by G, we can take one point from each orbit. 

Each (n— l)-dimensional hyperplanc in M" defines a special transformation, the 
reflection which takes each point in R" to its opposite point on the other side 
of the hyperplane. In particular, the transformation of K 2 (- D + Ar ) which takes pij 
into — pij and leaves all other coordinates unchanged is a coordinate reflection, 
as is the one which takes r-y into — ry. A group of transformations generated 
by reflections is called a reflection group. In particular, let G be the group of 
transformations generated by the aforementioned coordinate reflections. Then for 
any transformation g G G, for any real-valued solution (p, r) of (**), its image g{p, r) 
also satisfies (**). Indeed, g simply changes the signs of some of the coordinates 
of (p, r). Thus the set of real- valued solutions to (**) is a symmetric real algebraic 
variety V, with G as its group of symmetries. 

We can take the quotient of V by G by, for example, considering only those points 
of V lying in the nonnegative orthant. The group G takes this orthant to each other 
orthant. There is exactly one point of V in the nonnegative orthant for each Nash 
equilibrium, obtained by taking the nonnegative square root of each coordinate 
of the Nash equilibrium. So the set of Nash equilibria is the quotient of a real 
algebraic variety by a reflection group. In fact, any semialgebraic variety defined by 
a system of polynomial equations and inequalities in which none of the inequalities 
are strict, is also the quotient of a real algebraic variety by a reflection group. For 
each inequality constraint f(x\, . . . , x n ) > 0, we can define a new variable v and 
change the inequality constraint into two constraints f{x±, . . . , x n ) — v = and 
v > 0, then proceed as above. 

4. Eliminating The Complementary Slack Variables 

Fix a player i S J, a pure strategy sy S Si of player i, and a pure strategy Ski k £ Sk 
for every other player k G / — {«}, giving a pure (— z)-strategy profile G S-i. 
Then the system (*) implies that 



Ui(Sij,0--i) + Vij = u l (s l0 , cr_j) + v l0 . 
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Multiplying through by 

n n Vkm ^ 

kei-U} m k=° 

which we denote by p(s_,), and using that <7km k Vkm k = 0, we find that 



)d k 
n n Vkm * 
k£l-{i] m k = ° 

m k^ l k 

\ dk 

= [ Ui(s i0 ,S-i) cr klk +v i0 \ v km , k . 

kel-{i} I k£l-{i} m k=° 

m k^ l k 



Every other term in m(sij, <J-i) is killed by one or more of the Vkm k 's, and similarly 
for Ui(sio, G-i. Next we substitute 1 — Yl ^k=° &km k for <Jki k in each factor of 

the product n^e/--^} a ki k , and note that every nonconstant term in the resulting 
polynomial is also killed by one or more of the Vkm k 's. Finally, we have 

d k 

(Vij - Via +Ui(Sij,S-i) -Ui(s i0 ,S-i)) v kmk = 0, 

kGl-ii} m k=o 
™k&k 

an equation involving only the complementary slack variables. Clearly, for this 
equation to hold, either — ViQ + Ui(sij, s_j) — Uj(sjo, s_») or one of the Wfc mfc 's 
must vanish. 

In this way we obtain a system of equations in the uy's, which we denote by 
(V). Denote by (Vj) the subsystem corresponding to fixing player i above, and by 
(Vj )S _ i ) the subsystem corresponding to fixing player i and the pure (— i)-stratcgy 
profile S-i. 

If p(s-i) ^ for some s_i G S'-i, then the system of equations (Vt a _ 4 ) reduces 
to «ij = «io + Ui(sio, s_j) — Ui(sij, S—i) for each 7 = 1,..., dj. The solutions to this 
system along with the nonncgativity constraints v^ > lie along a ray parametrized 
by u i0 , with 

V i0 > max (Ui(Sij, S-i) - U.;(s; , S-i)) . 

Only for those j = 0, . . . , di at which Ui(sij, s_j) — Ui(sio, s_j) attains its maximum 
can ever vanish; the rest of the Wy's must be positive. But since X] j=o °y = 1 
with tJy > 0, at least one cr^- must be positive, and thus since (JijVij = for all 
j, at least one v^j must vanish. Therefore we have a unique solution, the point 
with Via = max^ (uj(s,j, s_j) — Uj(siO) s -i))- Let us denote this point by q(s-i) E 

For generic games, the point g(s_j) corresponding to will be different from 
the point q(s'_ i ) corresponding to s'_ i for any other s'_ i € S—j. Thus the system 
(Vj) reduces to the following + 1 alternatives: either 



p(s-i) = for all s_, € S-i, 
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or for some 6 S-i, we have the system (V*~*): 



p(s^) = for all ,s_, e S_< - {**.}, (vf iP ) 



and 



{v i0 ,...,v idi ) = q(s*_ i ). (V- ' ) 



For generic games, exactly one of the Vij's will vanish at the point q(s*_ i ). 

We now introduce some notation from logic. The symbol A means "and" and 
the symbol V means "or" (in the Boolean sense). Suppose ipo and <p-y are Boolean 
expressions. Then the expression ip§ Afi, meaning "</?o and tfi" , is the conjunction 
of (po and ip\. The expression (po V ipi, meaning u ipo or <pi" , is the disjunction of 
ipo and ip\. Suppose ipo, . . . , ip n are Boolean expressions. Then A™=o *Pi denotes the 
conjunction of ipo, ■ ■ ■ , </?«.) and V™=o V« denotes the disjunction of ipo, . . . ,ip n . The 
distributive law holds for conjunction and disjunction just as it holds for multipli- 
cation and addition. 

Lemma 2. The solutions of the system (V?) are given by 



N d k d k 



V V V K' = 0) A (v kl = 0) . 



fc=l 7=0 i =1 



Proof. We proceed by induction on the number TV of players. First suppose N = 2. 
Without loss of generality, fix i = 2. Then each s_i is s\j for some j. The equation 

(Vf Sl ) is p( s 1j) = Il^io viz = 0, which holds if and only if \f d il ( v u = 0). So 
the system (V??) holds if and only if A-,4o V'=° C^ii = 0)- We show by induction 
on di that this expression is equal to Vjio \A=i ( v ij = 0) A (fi; = 0) which equals 

V"- Vto V*i («« = °) A («w = °)- For d i = !. 

J i > j 



1 1 



AV^ = °) = AKh) = o) 

= 0) A («io = 0) 



j=0 l=o j=0 



\/ \/ («y = 0) A = 0) 



J=0 1=1 
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Now assume that /\* V?=i fai = 0) = Vli V?^ ( U U = 0) A fa, = 0). Then 

J 1*3 i>3 

di di / di \ di di 



AV("" = °) = (\/(^ = °)) A A V(^ = °) 

dl \ dl dl 

V = °) ) A A = °) v V = °)) 

1=1 ' j = l '=i 



1=1 

d\ \ d\ d\ 



\/ fa, = 0)) A (fa = 0) V /\\/ fa, = 0)) 

/ di \ di di 

V ^ = °) ) A = °) v V V K- = °) A ^ = °)) 

di s 

\/ fao = 0) A fa, = 0) 1 
i=i ' 

V^(\/ («u = 0)) A \) (fa,- = 0) A (V fa* = 0)))" 



/ di N 

V V ( u w = °) A = °) 

S=o '=i ' 

vf( \) («y = o)) a \) = o) a (y fai = o))^ 

d% s di , di 

V V = °) A ( w » = o)) v \/ ( ( v y = °) a ( V = °) 

1=0 1=1 ' 1 = 1 ^ 1=1 



3 l>i 

d-i di 



V V ^ = °) A ( u » = °) • 



3=0 1 = 1 

Now assume the lemma holds for any number of players less than N. Fix i G 
I - {N}. Suppose that V *=i Vi=o V ?*i («fcj = 0) A fa, = 0) holds. Fix n £ 7 - {i} 
and j, m £ S n with j 7^ m such that !i nj - = and v nm = 0. Consider a pure strategy 
Ski k G Sk for every player fc £ 7— {1}, giving a pure (— l)-strategy profile G SLj. 
The equation (Vf s _.) is 



P(s-i) = _ v kmk = 0. 



fce/-fi> m fc=° 
™ k *i k 



Either £„ = j, in which case the product vanishes since it includes v nm ; or l„ = m, 
in which case the product vanishes since it includes v n j\ or s n i n G S n — {s n j, s nm }, 
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in which case the product vanishes since it includes both v n j and v nm . Thus the 
equation (V? a _.) holds. So the system (V?) is satisfied. 

Conversely, suppose the system (V?) holds. If there exist j, m G S"jv with j 7^ m 
such that vjyj = and VNm = 0, then V^ 1 V,=o V»^i = 0) A (vki = 0) holds, 

fc^i J l>j 

so assume there do not exist such j,m G Sn- Then there exists j G Sn such 
that VN m # for all s Nm G Sjv - {s/vj}- Write = Ilfcei— fi./v} Consider 
all elements of given by pure strategies sjM fc G Sk for fee/ — {i, iV} and 
stvIn = s JVj G Sn- Thus s_i has the form s_j = (s'_ i} SNj) for some G S 1 ^. The 
equation (V? s _.) is 

p( s ~i) = n n Vkm * = 

kei-U) m k=° 

Since Ujvm 7^ for all s/v TO G S^v — {sNj}, this equation is equivalent to the 
equation p(s'_J = Tlfcej-a w| 11^=° u fcm fc = 0. By the induction hypothe- 




tic 



sis, these equations imply that V*^ 1 V^=o Vi=i = 0) A (u/y = 0) holds. Thus 

Vf= V?=i («« = o) A («w = °) holds. D 

Lemma 3. Firr i G I and fix pure strategies Ski k G Sk for each k G J — {i}, defining 

a (— i)- strategy profile s*_ i G TTien i/ie solutions of the system (V^ - * ) are 

given 6j/ 

JV N d k d k 

A = °) v V V V = °) A («« = °) ■ 

fc=i fc=i 7 ' = o 1=1 

k^i k^i J l>j 



Proof. Suppose (v klk = 0) V V?=i \/% V*i («fcj = 0) A (« w = 0) holds. If 



N d k d k 



V V V = °) A («« = °) 



fc=i 1=0 ' = 1 



holds, then by Lemma [21 the system (V?) holds so a fortiori the system (V* ,P ) 
holds. Suppose /\fc^=i (vfcz fc = 0) holds. Let s_i G S-i — {sl^} with components 
Skn k G 5 fe . Then 

JV d k 



P (s- i )=u n 



Vkm k ■ 



k = l rn k =0 



Since s_i ^ sl i; there is some k G / — {i} such that =/= Ik- Then Vki k appears in 
the product, and so p(s-j) = 0. So the system (V*~* P ) holds. 

Conversely, suppose /\k=i (v k i k = 0)V\J^=i V,-=o \J iti (v k j = 0)/\(v k i = 0) does 

not hold. Since /\fc=i ( v ki k = 0) does not hold, there is some k' E I — {i} such that 

w */z fc / 7^ 0. Also since V^ =1 V 9 =o V»=* = 0) A (ufcz = 0) does not hold, for each 

kjti ■> t> j 

k G I - {i}, cither v k j ^ for all s k j G S k , or w fc „ fc = for a single s knk G 5 fe and 
i'fcm fc 7^ for all mfc with Skm k G iSfc — {skn k }- In either case, there is some n*, with 
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Skn k € Sk such that Vkm k ^ for all nik with Skm k G <Sfc - {sfc,i fc }- In particular, for 
kl we can choose ny ^ , because in the former case, any ny other than ly will 
do, and in the latter case, the single n k > with Vkn k , = must not be equal to ly , 
since Vk'i k , 7^ 0. Define s_j G S-i with components Skn k S Sfc such that Ufc mt 7^ 
for all m k with s fc „ ifc £ Sk - {skn k }, for all G I - {i, fc'}, and n k , 7^ l k ,. Then 

AT d k 

p( s -t) = n n vkm * ^ ° 

fc=l m fc =0 

by the choice of the n fc 's. Since ra^ 7^ we have s_j £ 5_, — {s* i }. So (V*~^) 
does not hold and the system (V*" ,P ) does not hold. □ 
Corollary 4. The system (Vj) holds if and only if either 

N d k d k 

V V V K- = °) A (*« = °) . 

fc=l 7=0 (=1 

kjti I>j 

or for some pure strategies s/y £ Sk for each k E I — {i} defining a (— i)- strategy 
profile si, G S_j , we /icrae 

(uio, ■ ■ .jVidJ = g(s < L l ), 
u fcit = f or each k G J — {i}, 

and 

Vfcm fc 7^ for all mk 7^ lk, for each k G / — {i}. 

Proof. This follows from our characterization of (Vj), Lemma [2] and Lemma [3l Wc 
impose the condition 

Vkm k 7^ for all mk 7^ lk, for each k £ I — {i} 

in the latter alternative because otherwise, the former alternative holds. □ 

Suppose we have a solution of the system (V) in which the latter alternative 
holds for some i G I. As noted earlier, for a generic game, exactly one = (the 
one for which Uj(sy, s_j) — Uj(sjo, S-i) attains its maximum, i.e., the one for which 
Ui(sij , S-i) is maximum) and the rest are zero. So the former alternative cannot 
hold for any k G I. Define U by vu t = 0, and let s* = (s^^slj) G S. For each 
k G I, the payoff Uk(ski k , s*_ k ) must be the maximum among Uk(ski, s*_ k ). Since 
Vki 7^ for / 7^ Zfe, we must have crfci = for I ^ lk, so Ufc^ = 1. That is, cr is the 
pure strategy profile s* . So this is the case of a pure strict Nash equilibrium s*, 
that is, one for which the pure strategy si is a strictly better response to s*_ k than 
any other pure strategy of k, for each k G I. 

Note well that this is a weaker condition than that s* be an equilibrium in 
dominant strategies. For example, consider a game of two players who each can 
take one of two actions, in which the payoff to each player is the same if they take 
the same action and strictly less if they take opposite actions. This game has two 
pure strict Nash equilibria, corresponding to both players taking the same one of 
the two actions. But neither of the actions is a dominated strategy for either of the 
players. 

Suppose the latter alternative holds for some i £ I and both Vij = and Viji = 
for some j 7^ f. Then this makes the former alternative true for every k G / — {i}. 
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Finding pure strict Nash equilibria is a combinatorial procedure which does not 
require any polynomial algebra. Therefore we do not discuss it further in this 
article, but assume that we have already found all pure strict Nash equilibria (if 
any exist), and are now interested in finding the other ones. 

Proposition 5. Suppose a is a Nash equilibrium of a generic game, and a is not 
a pure strict Nash equilibrium. Then there are two players i,k & I with i ^ k and 
two pure strategies each, Sy , £ Si with jo ^ ji and s k i , s k i k G Sk with Iq ^ l\, 
such that Ui(s ij0 , o-_i) = u i (s ljl ,a_ i ) = u t (a) and u k (s m ,a_ k ) = u k (s M1 ,a_ k ) = 
u k (a). 

Proof. The first alternative in Corollary |4] must hold for each i £ I. Pick a player 
n G /. The condition 

N d k d k 

V V V K = 0) A (v kl = 0) 

fc=l 5=0 1 = 1 

k=tn J l>j 

means there is k ^ n and pure strategies s k i ,s k i 1 S S k with v k i = v k fa = 0, 
i.e., u k (s k i ,a_ k = u k (s kh ,o-- k ) = u k (a). This makes (V TO ) hold for every player 
me/ — {k}. For k itself, the condition V^ 1 Vi=n Vi= J { v *j = 0) A (vu = 0) means 

there is i ^ k and pure strategies Sy , € Si with Ui(sijo, cr_,) = u^Siji, cr_i) = 
Ui{a). □ 

In this case we cannot isolate aij and aij 1 simply by looking at the best responses 
for i, and similarly with k. We must solve the polynomial system (*). 

As noted before, at least one v nm must vanish for every n E I. In the conditions 
of the proposition, the least complex case is that exactly one v nm vanishes for each 
n £ I — {i, fc}, say v nmn ; that > for j ^ j and j ^ j 1 ; and that v k i > for 
k fco and k ^ k\. Then each player n E I — {i,k} executes pure strategy s nmk . 
Furthermore i does not execute pure strategy Sjj with any probability for j ^ jo 
and j ^ ji , and fc does not execute pure strategy s k i with any probability for I ^ Iq 
and I ^ h. Then the system (*) reduces to the system for a game with two players, 
which we renumber as 1 and 2, with two pure strategies each, which we renumber 
as sio, sn, S20, and S2x- Write it^ = iti(scy, su). In this case the system (*) is: 

ulo°~20 + Wcu^i = u\ a2o + M11CT21, 
■"oo^io + Wio CT ii = "oi^io + u n an, 
cio + cn = 1, 

°20 + °21 = 1- 

Substituting 1 — an for crio and 1 — 021 for 0201 wc obtain 

1 1 2 2 , 2 \ 2 2 

(u u - u 10 - u Q1 + u 00 )o-n = u 00 -u 01 . 

Notice that the equilibrium found by this system need not be totally mixed; for 
instance, Uq — u\ could equal zero, in which case 02 — S20, or u\-± — uji could 
equal zero, in which case 02 = S21- (If they arc both zero, then player 1 has no 
control over player l's own payoff and hence every mixed strategy of player 1 is 
a best response. So the requirement that 1 play a best response, which leads to 
the first equation, does not impose any constraint on the strategy 021 of player 2.) 
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Similarly, Ug — could equal zero, in which case u\ = sio, or u\i — u\ could 
equal zero, in which case a\ = s\\. Both of these cases may even occur, in which 
case the root of the system is a pure Nash equilibrium. 

Any solution to the system (*) induces a partition of P d = \J ieI Si into two sub- 
sets, the subset Pq such that Vij = for all G Po and the subset P + such that 
Vij > for all Sij G P+. If we make a choice of such a partition, then = for 
all Sij G -P+, so eliminating these strategies and considering the reduced game, the 
system (*) reduces to the system (E): 

Ui(sij,a-i) = Ui(sio,(7-i) for each i G I and for j = 1, . . . , di, (E„) 

^ cr.y = 1 for each i £ I, (E.; ) 

and all the c^'s are nonnegative. (A root of the polynomial equations of the 
system (E) which does not satisfy the nonnegativity constraints is called a quasi- 
equilibrium.) After solving the system (E) to find a candidate a, we have to check 
that for each strategy 8y of the original game which we had eliminated, = 
Ui(a) — Ui(sij,a—i) is indeed nonnegative. In that case a is a solution to the 
original system (*) and hence a Nash equilibrium of the original game. To find all 
the Nash equilibria, we can perform this procedure for all partitions (Pq,P+) for 
which at least one s nm G Pq for each player n. As noted above, for a generic game 
there will not be a Nash equilibrium for which there is exactly one player for which 
at least two s^ 's are in P . 

From now on we will restrict our attention to solving systems of the form (E). 
The paper [17] describes this system, which along with the constraints ov, > for 
all the cry's, gives the totally mixed Nash equilibria. The Gambit software package 
[18j finds all Nash equilibria recursively, by finding totally mixed Nash equilibria of 
each reduced game by solving the corresponding system. This algorithm for finding 
all Nash equilibria is described for example in [T2] and in [Fj. 

5. Solving An Instance of the Polynomial System 
For any s G 5, with s; = s,j 4 for each i G /, we write 

u )i...j N = u i( s ljn s 2j2) ■ ■■ i s (i-l)j»_i> s ij> s (i+l)j» + n ■ ■ ■ i s Nj N ) 

-U l (sij 1 ,S 2j2 , . . . ) S(i- 1 )j._ 1 ,SiO,S(i +1 ) ji+1 ,. . .,S N j N )- 

In particular uj^ _ _ • = if ji = 0. Then the equation (Ey) is 

di di—\ di+i rfjy 

E " ' E E " ' E U h...ji-l3h+i.--3N a lh ■ ■ ■ ^(i-l)j«-i^(<+l)j«+i • ■ ' °Nj N = 0. 
3i=0 Ji-i=0j<+i=0 jw=0 

How do we solve an equation like this? We note in passing that if all the coefficients 
u ji ji-ijji i 3n nac ^ ^ ne same s iS n ) we would know that either all the monomials 
vanished (i.e., <Jki a = &kh = for some k G I — {i} and 1 < Iq < l± < dfe), or cr^ = 
and > Vio- However, this condition depends on the choice of which strategy in 
St to label as Sio, so to check whether it ever arises would require checking the 
difference between every pair Ui(sij 1 , s_i) — Ui(sij , s_,). 
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Well, if the equation factored, it would be easy to solve. That is, if we could find 
numbers Mfc/^ f° r k E I — {i} and Skj k E S k such that 

J2 " ' U )l-H-l3k+l-3N a ^l ■ ■ ■ 0"(<-l)j 4 -iO"(i+l)i*+i ■ ■ ■ °"JVi w 

ji=Q ii-i=0j i+ i=0 j„=0 

- n (e^*4 

feGI-{i} S'fc=0 7 

then we could solve the equation by setting X j,*=o ^kjl ak ik equal to zero for some 
kel-{i}. 

The factorization holds if and only if the coefficients of each monomial 

on both sides of the equation are equal. The coefficient on the left-hand side is 
u\ i ■■ ■ , and the coefficient on the right-hand side is Ffi.cr u\ P&P ■ Thus 

Jl ■ ■ -Ji— 1 JJi+1 ■ ■ -JN ' ^ A A/St ^ — \*f ' ^Jk 

we have a system of equations Ylkei-U} t^kfi = u ji-ji-ijji+i...jN- Equivalently 
we have the system of linear equations J2kei-{t} lo S Wkjl I = lo S \ u h-3i-i3h+i-jN I 

together with sign conditions Ukei-{i} ^(dkjl) = si S n ( u ji...j*-ijj <+ i...j>)- Unfor- 
tunately this linear system is overdetermined and hence usually inconsistent. We 
have 0^ =1 (^t + 1) equations in only X^ =1 + 1) unknowns fjfj!p . So in general, 
equation (E,j) does not factorize. 

Nevertheless, suppose all the equations (Ey) did factorize. How would we solve 
the whole system (E) then? For one thing we would substitute ako = 1— 2jk=i a kj k 
into each linear factor X^=o Kjl <Jk Jk to get an affine linear factor 

d k 

.,(«) , W.,W) „W)\„ 
VkO + A^^kjk ~ V k0 )Vkj k - 

3 = 1 

("Affine" just means that it includes a constant term.) We set = — fx^' 

for j k = l,...,d k and Xj£' = fi^' . 

We will now construct a particular system in which all the equations factorize, 
and solve that. For this purpose, it will be convenient to have available a totally 
nonsingular matrix. An m x n matrix M = (my ) is totally nonsingular if for every 
k < min(m, n), for every subset R C {1, ...,m} with \R\ = k and every subset 
C C {l,...,n} with \C\ = k, the k x k submatrix of M given by (my) iefl is 
nonsingular. 

Let / : N — > R>o be any injection of N into R>o- We can use the algorithm in 
Figure [T] to construct a totally singular n x n matrix for any n. We start with the 
lxl matrix (mn) = (/(l)), which is clearly totally nonsingular. The problem of 
filling in a matrix while maintaining some condition is called a matrix completion 
problem. [25j shows that we can construct a totally nonsingular matrix by filling 
in the entries one at a time, as in the above algorithm. In fact, at each stage 
there are only finitely many possible values of the next entry which would violate 
the condition, so all we have to do is avoid those values. Therefore each while 
loop in the algorithm will always terminate. Since the partially filled-in matrix 
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for i = 1 to n do 

Invariant: Every submatrix of the partially filled-in matrix is nonsingular. 
Invariant: The matrix is symmetric, 
for j = 1 to i do 

k <- i + j - 2 
mij <- /(&) 

while some submatrix which includes m,j is singular do 

7/ly ^ /v/y 

if my > then 

We've already tried this value of my , so try another 
k <- k + 1 

mij <- /(fc) 
end if 
end while 

TYlji 4 my 

end for 
end for 

FIGURE 1. One Possible Algorithm To Compute A Totally Non- 
singular Matrix 



is symmetric, and my does not violate the condition, setting niji = m,j cannot 
violate it cither, and we can keep the matrix symmetric. For example, here is the 
totally nonsingular 6x6 matrix given by the above algorithm, with f(k) = 2 fc ~ 1 : 



1 


2 


4 


8 


16 


32 


2 


-4 


16 


-32 


128 


-256 


4 


16 


-16 


-128 


1024 


-256 


8 


-32 


-128 


-64 


4096 


4096 


16 


128 


1024 


4096 


-256 


1024 


32 


-256 


-256 


4096 


1024 


-1024 



As a matter of fact, a random matrix will be totally nonsingular with probability 
one. However, if we do use a random matrix we should check that it is indeed totally 
nonsingular. Since checking this may take a long time, it may be useful to build a 
large totally nonsingular matrix once and for all and keep it around. 

Now assume we have a totally nonsingular D x D matrix M with entries m,j. 
Define n(i,j) = j + J^l =1 dfc- So if we write the equations (Ey) in sequence 
(En), . . . , (EidJ, . . . , (Ejvi), • • • , (Ejvd N ), then the n(i,j)th equation in the se- 
quence is (Eij). Set Aj.j = fn n {i,j)l k f° r h > and A^' = —1. This defines 
a particular system (S) of equations which factorizes. 

Notice that we don't use all D 2 entries of M. For each player i, we use J2kei-{i} dk 
rows and di columns of M. Thus we could just use a totally nonsingular matrix 
with D — miiiig/ di rows and max^g/ di columns. 
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For example, for a game of 3 players with 3 pure strategies each, using the above 
6x6 totally nonsingular matrix, we arrive at the system: 

((721 + 2(722 - 1)(<731 + 2(732 - 1) = 0, 

(2(721 - 4(722 - 1) (2(731 - 4(732 - 1) = 0, 

(4(7n + 16ai2 - 1) (4(73i + 16(732 - 1) = 0, 

(8(7n- 32(712 - 1)(8(731 - 32(732 - 1) = 0, 

(16(7n + 128(712 - 1)(16(7 2 1 + 128(722 - 1) = 0, 

(32(7n - 256cri2 - 1) (320-21 - 256(7 22 - 1) = 0. 



If we replaced the 1 in each factor by X^=i a kj k an d expanded out the polyno- 
mials, we could determine for which payoff functions this is the system (E,j). For 
instance, in the second equation the coefficient of (722(731 becomes —9, so this says 
Ui(si2, S22, S31) — Ui(sio, S22, S31) = —9. The coefficient of (720C30 becomes 1, so 
this says ui(s 12 , s 2 o, s 3 o) - Ui(s 10 , s 2 o, S30) = 1- 

Now to find all the solutions to this system, we define a D x D matrix P by 
P n (i,j)n(k,l) = Hi = k and P n (i,j) n (.k,l) = 1 if i ^ k. In the example of a game 
with 3 players, each with 3 pure strategies, we have 



P = 









1 


1 


1 


1 








1 


1 


1 


1 


I— 1 


1 








1 


1 


I— 1 


1 








1 


1 


I— 1 


1 


1 


1 








1 


1 


1 


1 









We associate the n(i,j)th row with the equation (E^) and the n(i,j)th column 
with the variable C7y . So an entry of P is 1 if and only if the corresponding variable 
appears in the corresponding equation. 

The reader is familiar with the determinant of a matrix, which is the sum of 
certain signed products of entries of the matrix. The permanent of a matrix is the 
sum of those same products of entries of the matrix, but without the signs. In other 
words, for an D x D matrix P, the permanent of P is the sum over all permutations 
t of 1, . . . ,D of the products []^ =1 P nT („). 

To find a solution of (S), we pick D entries of P whose product contributes 1 to 
the permanent of P. In other words, we pick a permutation r of 1, . . . , D such that 
H^Li P nT ( n ) — 1- For example, the italicized entries below represent such a choice: 

1 1 1 1 " 
1 1 1 1 
110 11 

110 11 
11 110 

111 100 

Now if r(n(i,j)) = n(k, I), this tells us to make equation (E^) hold by setting the 
factor 1 + X^=i ^kjl a kjk equal to zero. In the above example, the above choice 



FINDING ALL NASH EQUILIBRIA OF A FINITE GAME USING POLYNOMIAL ALGEBRA17 

tells us to set: 



0- 31 + 2cr 32 -1 = 0, 

2(721 - 4(722 - 1 = 0, 

4(7n + 16(712 -1 = 0, 

8(731 - 32(732 - 1 = 0, 

16(7n + 128(712 -1 = 0, 

32(721 - 256(722 - 1 = 0. 



Now we have a system of linear equations in the di variables c^, for each i. Since 
we chose the coefficients from a totally nonsingular matrix, each system of di linear 
equations has a unique solution. In this case, we find: 



Oil = T _ ; cr 12 

16 



64 



021 



21 

32 



j °"22 



64 



, ^31 



17 

24 



j CT 32 



7 

48' 



(Clearly this particular solution does not satisfy the nonnegativity constraints, 
which we would also have to check if we were interested in the Nash equilibria 
of this particular game.) 

Notice that this procedure would give us the same set of equations multiple 
times. For example, the choice of D other entries in P represented by the italicized 
entries below: 









1 


1 


1 


1 








I 


1 


1 


1 


1 


1 








1 


1 


1 


1 








1 


1 


1 


1 


1 


1 








1 


1 


1 


1 









gives the same system of equations. The problem is that for each set of di columns 
corresponding to the variables an, . . . , cr^, we can apply any permutation to that 
set of columns without affecting the meaning of our choice. So if we carried out 
this procedure naively, it would repeat each solution Ilie/^' times. We should 
avoid solving the same system twice. However, if we obtain the same solution from 
a different choice of which factor in each of the equations to set to zero, then we 
should perturb our totally nonsingular matrix so this doesn't happen, for reasons 
which will become clear later. 

Carrying out this procedure, we find all 10 roots of (E). We list the values 
of (an, 012, 021, 022, 031, 032) below, along with the corresponding permutations of 
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1,...,D: 



3 13 13 1 
64 '512' 4' 8' 16' 64 
7 3 21 -5 5 -1 
32' 128' 16' 32' 12' 24 
17 7 21 -5 7 3 
96'384'16' 32 ' 8' 16 
5 -1 129 31 5 -1 
48' 192' 160' 320' 12' 24 
7 -3 129 31 7 3 
16' 64' 160' 320' 8' 16 
7 3 33 -7 7 -3 
32' 128' 80' 160' 4' T" 
17 7 33 -7 17 7 
96'384' 80' 160' 24' 48 
5 -1 21 5 7 -3 
48' 192' 32' 64' 4' "8~ 
7 -3 21 5 17 7 
16' 64' 32' 64' 24' 48 
3 13 13 1 
16' 64' 64' 512' 4' 8 



5,6,1,2,3,4 
4,6,1,5,2,3 
3,6,1,5,2,4 
4,5,1,6,2,3 
3,5,1,6,2,4 
4,6,2,5,1,3 
3,6,2,5,1,4 
4,5,2,6,1,3 
3,5,2,6,1,4 
3,4,5,6,1,2 



We note that the first and last of these satisfy the nonnegativity constraints, and 
hence are Nash equilibria. (The reader may notice some symmetries between pairs 
of the solutions. This is because we happened to use the same region of M for all 
the players.) 

We can find the rest of the solutions of the system (*) corresponding to this same 
game too. Suppose we require Vij to be positive instead of vanishing. Then the 
variable goes away from every equation and the equation (Ejj) is replaced by 
the equation = 0. In the above example, suppose we require U31 to be positive. 
Then we obtain a new system 



((721 + 2^22 - 1) (20-32 - 1) = 0, 

(2(7 2 i ~ 4(722 - 1)(4(7 32 - 1) = 0, 

(4(7ii + 16<7ia - 1) (16(732 - 1) = 0, 

(8(7n - 32(712 - 1) (32(732 - 1) = 0, 

0-31 = 0, 

(32(7n - 256cri 2 - 1) (32(72i - 256er 22 - 1) = 0. 



This system corresponds to the n(i,j),n(i,j) minor of M, which is also totally 
nonsingular. We can use the same matrix P, but zero out the n(i,j)th row and 
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n(i,j)th column and set the n(i,j),n(i,j) entry to 1. In our example: 









1 


1 





1 








1 


1 





1 


1 


1 











1 


1 


1 











1 














1 





1 


1 


1 


1 









Now we follow the same procedure as above, performing the cofactor expansion 
of the permanent along the n(i,j)th row. For example, the product of italicized 
entries below contributes 1 to the permanent of this matrix: 









1 


1 





1 








I 


1 





1 


1 


1 











1 


1 


1 











1 














1 





1 


1 


1 


1 









The corresponding system is: 

(T 2 1 + 2<T 2 2 -1 = 0, 

2a 2 i - 4cr 2 2 -1 = 0, 

4(7n + 16(712 - 1 = 0, 

32(732 - 1 = 0, 

0-31 = 0, 

32crn - 256cri2 -1 = 0. 



Its solution is: 



17 7 

an --,(712-—, 

3 1 

<J21 - -,^22 - -, 
0"31 = 0, (7 3 2 = — . 



This at least satisfies the nonncgativity constraints on the OYj 's. If we are interested 
in the Nash equilibria of this game, we also have to check that it satisfies the 
nonncgativity constraints on the u-y's, namely, that V31 > 0. We substitute the 
cry's into 

(16(7n + 128(712 - 1)(16(7 2 1 + 128(722 - 1), 

the expected payoff to player 3 from playing <7 3 i, obtaining 2§^, which is strictly 
greater than zero. So this solution to the polynomial system is not a Nash equi- 
librium, since S31 is a strictly better response to ct_3 than the value of (73 given by 
this solution. 

In this way we see that our specially constructed factorizable game of a given for- 
mat (TV; di, ■ . ■ , div) contains subgames of every smaller format (N' : d[, . . . , d' N ,), 
with N' < N and d\ < di for each i, such that the subgames are also factorizable. 
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As we will see, we only need to solve one (or a few) of the factorizable polynomial 
systems for each format in the manner we have described so far. 

Geometrically, by constructing the D x D totally nonsingular matrix M, we 
picked D vectors in Z?-dimcnsional space, such that not only are these all distinct 
points, but if we project any to of them onto any m-dimcnsional coordinate sub- 
space, the images are all also distinct. The condition that two particular such images 
coincide is an equation, which is satisfied only on a subset of real £>-dimcnsional 
space of strictly lower dimension. So every open subset of real /^-dimensional space 
does not satisfy the condition, almost everywhere. Since there are only finitely 
many of these conditions, every open subset does not satisfy any of them, almost 
everywhere. In particular, we could construct a totally nonsingular matrix such 
that all the nonnegativity constraints of our factorizable game also held with strict 
inequality. However, while this would provide an example of a game with the 
maximal possible number of totally mixed Nash equilibria, it would not be particu- 
larly relevant to the use we will be making of our specially constructed factorizable 
games. 

6. POLYHEDRA AND POLYNOMIAL SYSTEMS 

With a system of polynomial equations is associated a polyhedral subdivision, that is, 
a polyhedron which is subdivided into cells, each of which is also a polyhedron, glued 
together along their faces. We illustrate this for a game of 3 players with 2 pure 
strategies each, since in this case the polyhedral subdivision is 3-dimcnsional. Using 
the same totally nonsingular matrix, we obtain the following system of factored 
equations: 



(1) (<72i - l)(ff 3 l - 1) 0, 

(2) (2oii-l)(2o- 8 i-l) = 0, 

(3) (4aii -1) (4a 2 i-l) = 0. 
Expanding this out, we obtain 

(4) 0-21(731 — C21 — 0"31 + 1 = 0, 

(5) 4o-iicr 3 i ~ 2ctii - 20-31 + 1 = 0, 

(6) I60110-21 - 4o-ii - 4o- 2 i + 1 = 0. 

A monomial x^x^ 2 • ■ ■ x" n in n variables can be represented by the lattice point 
(pt\, . . . , a n ) € N n of its exponents. For example, the lattice of monomials in two 



variables x and y is depicted in Figure O 

The Newton polytope of a polynomial equation is the convex hull of the lattice 
points of the monomials occuring in that equation. In our example system in 3 
variables an, a%\, and 031, the Newton polytope of Equation [4] is depicted in 
Figure [3l the Newton polytope of Equation [5] is depicted in Figure [4] and the 
Newton polytope of Equation [6] is depicted in Figure 

The Minkowski sum of an n-dimensional polytope with vertices V01 , ■ ■ ■ , Vo mo 
and an n-dimensional polytope with vertices Vn, . . . , V\ mi is the convex hull of 
the points Vb; + V\j in n-dimensional space, for i = 1, . . . , too an d j = 1, • • • , mi- 
Figure [6] depicts the Minkowski sum of the Newton polytopes of Equation [4] and [5] 
We can think of the Minkowski sum as translating one of the polytopes along each 
edge of the other polytope. Here we have colored the vertices and edges as if we 
first translated the red polytope along each edge of the green polytope. The red 
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Figure 2. The Monomial Lattice in Two Variables 
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FIGURE 3. The Newton Polytope of 0-210-31 - o 2 i - 0-31 + 1 = 

0-11 




0"21 



Figure 4. The Newton Polytope of 4o-no- 3 i - 2o-n - 2o 3 i + 1 = 



edges came from the original red polytope, and the green edges came from edges 
of the green polytope along which we translated. Notice that we can do this in 
more than one way. For example, we could have colored the vertices and edges as 
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Figure 5. The Newton Polytope of I6ana 3 i - 4a n - 4cr 31 + 1 = 




Figure 6. Minkowski Sum of A Pair Of Newton Polytopes 

if we translated the green polytope along each edge of the red polytope first. Such 
a coloring of the Minkowski sum gives us a mixed subdivision, which in this case 
has two cells, the two cubes in Figure O 

Finally, the Minkowski sum of all three of our Newton polytopes is depicted in 
Figure [JJ A cell of a mixed subdivision is mixed if each color delineates only edges 
(or possibly vertices) in the cell, not higher-dimensional faces. In Figure [7j the top 
left front cube is not mixed, because two of its faces are green squares, and the 
top right front cube is not mixed, because two of its faces are blue squares. We 
see that two of the cells in this mixed subdivision are mixed. Each mixed cell tells 
us how to obtain certain solutions to the factorizable polynomial system. Namely, 
in each polynomial equation, we should look at the edges with the corresponding 
color in the mixed cell, and set the factor(s) corresponding to the directions of 
those edges to zero. In the game-theoretic case, there will be exactly one solution 
corresponding to each mixed cell, since the polynomial system has degree at most 
1 in any variable. 

For example, Figure [8] depicts the bottom mixed cell of the mixed subdivision. 
To find the solution corresponding to this mixed cell, we should set the factor 021 — 1 
to zero in the green Equation [TJ we should set the factor 2a 3 i — 1 to zero in the red 
Equation [2 and we should set the factor 4a \\ — 1 to zero in the blue Equation [5] 
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Figure 7. Minkowski Sum of Three Newton Polytopes 
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Figure 8. One Mixed Cell of the Mixed Subdivision 
This gives us the solution 

1 1 

011 = ^> 021 = 1, 031 = 2' 

Figure [9] depicts the top mixed cell of the mixed subdivision. To find the solution 
corresponding to this mixed cell, we should set the factor 031 — 1 to zero in the 
green Equation [2 we should set the factor 2an — 1 to zero in the red Equation [2l 
and we should set the factor 4o"2i — 1 to zero in the blue Equation [3j This gives us 
the solution 

1 1 

011 = 2 !<721 = 4' CT31 = 
In the game-theoretic case, the cells of the mixed subdivision are always D-dimensional 
cubes (or hypcrcubes). The matrix P in this example is 

" 1 1 " 
1 1 
1 1 
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Figure 9. Another Mixed Cell of the Mixed Subdivision 

Recall that the rows correspond to equations (and hence each will have a different 
color), and the columns correspond to variables. A permutation which contributes 
to the permanent will tell us how to color each variable. The edges of the mixed 
cube going in the direction corresponding to that variable will be colored with that 
color, and the linear factor containing that variable in that equation will be set to 
zero. 

7. Finding All Nash Equilibria by Polyhedral Homotopy 

Continuation 

We have taken considerable trouble to find all Nash equilibria of one particular kind 
of specially constructed game. The good news is that once we have done this for 
one particular game format, we can easily solve any generic game of that format Q 
Furthermore, we can even more easily look for one or a few of the Nash equilibria, 
look for Nash equilibria with some particular small support, and so forth. The key 
idea is to "morph" the specially constructed polynomial system into the polyno- 
mial system we are actually interested in. As we do this, the solutions to (E) for 
the specially constructed game will also morph into solutions to (E) for the game 
of interest. Moreover, this procedure is "embarrassingly parallel". The morphing 
of each solution is independent of the morphing of every other solution. We can 
partition the solutions to (E) for the specially constructed game into subsets, and 
hand each subset to a different processor. If somewhere along the way a morphed 
solution begins to look disappointing (for example, it doesn't look like it will end 
up satisfying the nonnegativity constraints, or it starts to have an imaginary com- 
ponent that we fear won't go away), we can always stop morphing that solution 
and come back to it later if more promising ones don't pan out. 

Readers may be familiar with the homotopy continuation method under the 
guise of "tracing procedures" , such as the techniques of Lemke-Howson or Govin- 
dan and Wilson. To solve a polynomial system by the homotopy continuation 

4t's not quite true that we only need to solve one game of each format. Something untoward 
could happen on the way from this game to the one we are interested in; e.g., we could run into 
a game whose set of Nash equilibria is positive-dimensional. So we should have the solutions to 
a few of the specially constructed games ready to hand. We can make more such games by using 
different regions of our totally nonsingular matrix. 
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method, we create a family T of polynomial systems fit = 0, fit = 0, . . . , f m t = 
parametrized by a variable t lying in [0,1], such that the polynomial system we 
want to solve is fn = 0, /21 = 0, . . . , f m \ = 0, and the polynomial system /10 = 
0, /20 = 0, . . . , f m o = 0, called the starting system, is easy to solve. Wc consider 
each polynomial system in T to lie in some topological space such that for any 
particular point, the map of the polynomial space which evaluates the polynomial 
at that point is continuous. We require the map from [0, 1] to this space to be 
continuous, or in other words a homotopy. Now suppose (xi, . . . ,x n ) satisfies the 
polynomial system fit , ■ ■ ■ ,fmt i and ti is near to. Since the homotopy is con- 
tinuous, /i tl , . . . , f mtl must be near fu , ■ ■ ■ , fmt , and so / ltl {x x , . . . , x n ) must 
lie near zero, f%t x {x\, ■ ■ ■ , x n ) must lie near zero, and so forth. Therefore, since 
polynomial functions are also continuous, we can look for a root of the system 
/iti, ■ • ■ -i fmti ne ar (xi, . . . , x n ). We make a prediction, i.e., we guess a possible 
root of fu 1 , . . • , fmtx near (xi, . . . , x„), and then a correction, i.e., we find an ac- 
tual root near our guess, using Newton's method for example. Once we have one, 
we can proceed to the next iteration for ti near t\, and so forth. At the end we 
will have a path from our original root (xi, . . . , x„) t= o to a root (xi, . . . , x„)t=i of 
the desired system. |13j presents a survey of previous uses of homotopy continu- 
ation methods in game theory. The book [23] gives a recent survey of numerical 
methods for solving polynomial systems, including detailed treatment of homotopy 
continuation, and in particular polyhedral homotopy continuation. 

If we fix the number of equations, and the Newton polytopes of each equation, 
then the set of such polynomial systems becomes a vector space over the coefficient 
field. Each monomial occurring in each equation corresponds to a basis element 
of this vector space, and a particular polynomial system is uniquely specified by 
giving the coefficients of all the monomials in all the equations. In particular, if the 
coefficient field is K then this space of polynomial systems is a finite-dimensional 
real vector space. Hence, it is equipped with a topology, the usual topology of such 
spaces. We will call the number of equations together with the Newton polytopes of 
each equation the shape of a polynomial system. Polyhedral homotopy continuation 
is simply homotopy continuation among polynomial systems of the same shape. The 
word "polyhedral" refers to the polyhedral subdivision introduced in the previous 
section. 

The Bernstein-Kouchnirenko theorem [2] [15] tells us that the number of 0- 
dimensional complex roots, none of whose components are zero, of every generic 
polynomial system of a given shape is the same. This number is called the Bernstein 
number of the system. Polyhedral homotopy continuation [14j provides an alternate 
constructive proof of this fact. Thus, if we apply polyhedral homotopy continuation 
to a generic polynomial system wc will find a unique (possibly complex) root of 
the system in question at the end of each path leading from one of the roots of 
the starting system. [T7] applied the Bernstein-Kouchnirenko theorem to find the 
number of complex roots of the polynomial system (E) for a generic game: it is 
the permanent of the matrix P, divided by riie/^i'- ^ n we generalized this 
theorem to polynomial systems obeying special conditions, such as those arising 
from graphical games. Briefly put, the special conditions imply that some of the 
entries in P are zero. 

In general, the most difficult part of polyhedral homotopy continuation is com- 
puting the mixed subdivision, finding a polynomial system which is generic, and 
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using the mixed subdivision to find all the roots. Once all this is done, we can follow 
a simple linear homotopy (i.e., of the form ft = (1 — t k )fo + t fi for some k > 1) 
from this starting system to the desired system, which is relatively straightforward. 
Therefore polyhedral homotopy continuation is particularly well-suited in the case 
of game theory, since we know exactly how to find and solve a starting system. 
The system (E^) is an example of a multihomogeneous system. Every monomial 
appearing in one of these equations has the same degree, namely 1, in all of player 
l's variables put together, the same degree, namely 1, in in all of player 2's vari- 
ables put together, and so forth. In the same way multihomogeneous systems are 
generally easy to solve by polyhedral homotopy continuation. As we saw, adding 
in the conditions (Ejo) does not make the problem more difficult, although it does 
mean multihomogeneity no longer holds. The system (E) is a linear product family, 
as described in Section 8.4.3 of [23] . 

We may not even need to find all the roots of the starting system before starting 
to find the Nash equilibria of the desired game. Once we have a single root of the 
starting system, we can start tracing it. However, if we are unlucky the correspond- 
ing root of the desired game may not be nonnegative or even real, in which case we 
will have to go find another root of the starting system to trace. [19] describes the 
expected number of real roots of a random multihomogeneous system of polynomial 
equations, and gives the lower bound as the square root of the Bernstein number 
(the number of complex roots of a generic game). 

Let's expand out our factorizable polynomial system for the game of 3 players 
with 3 pure strategies each. 

C21CT31 + 2(721(732 + 2(722 31 + 4(722 032 

-(7 2 1 - 2(7 2 2 - 0-31 - 2(7 32 + 1 = 0, 
4(721(731 — 8(721(732 — 8(722031 + 16(722032 

-2(7 2 1 + 4(722 - 2(731 + 40 32 + 1 = 0, 
16(7n(73l + 64(7n(732 + 64(712031 + 256(7l 2 032 

— 4<7ll — 16(712 — 4(7 3 1 - 16(7 3 2 + 1 = 0, 
64(7n(73l + 256(7ll(7 3 2 + 256(7120-31 + 1024(712 032 

-8(7n - 32(712 - 8(731 - 32(732 + 1 = 0, 
256(7n(721 + 20 48(711(722 + 20 48(7120-21 + 163 84(712 022 

-16(7ii - 128(712 - 16(721 - 128(722 + 1 = 0, 
1024(7n(721 — 8 1 92(711(722 _ 8192(712021 + 65536(7120-22 

-32(7n + 256(712 - 32(72i + 256cr 22 + 1 = 0. 

We can make an input file for the polyhedral homotopy continuation software PHC 
[26] which specifies this polynomial system. Since PHC orders the variables accord- 
ing to the order they have appeared in the file, we will write the equations in the 
reverse order from the system listed above, so that the variables will appear in the 
order <7n, o~i2, 021, 0-22, 031, 032- Here is the input file gameof 3x3x3_start_phc: 
6 

1 - 32*sll + 256*sl2 - 32*s21 + 256*s22 

+ 1024*sll*s21 - 8192*sll*s22 - 8192*sl2*s21 + 65536*sl2*s22 ; 
1 - 16*sll - 128*sl2 - 16*s21 - 128*s22 

+ 256*sll*s21 + 2048*sll*s22 + 2048*sl2*s21 + 16384*sl2*s22 ; 
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1 - 8*sll - 32*sl2 - 8*s31 - 32*s32 

+ 64*sll*s31 + 256*sll*s32 + 256*sl2*s3l + 1024*sl2*s32 ; 
1 - 4*sll - 16*sl2 - 4*s31 - 16*s32 

+ 16*sll*s31 + 64*sll*s32 + 64*sl2*s31 + 256*sl2*s32; 
1 - 2*s21 + 4*s22 - 2*s31 + 4*s32 
+ 4*s21*s31 - 8*s21*s32 - 8*s22*s31 + 16*s22*s32; 
1 - s21 - 2*s22 - s31 - 2*s32 

+ s21*s31 + 2*s21*s32 + 2*s22*s3l + 4*s22*s32; 

The first line specifics the number of equations, and the rest of the file specifies the 
equations. Since an unknown can only consist of up to 5 characters, we denote the 
variable <7\\ by sll in the file, and so forth. 

We could find the roots of this factorizable system using PHC itself (in which 
case we should tell PHC about the linear product structure of our equations), or 
using other programs in the manner described above. We will list the 10 roots of 
the starting system wc found before in another input file for PHC, which we call 
gameof 3x3x3_start_phc . roots. Here is the beginning of that file, including the 
first two roots: 

10 6 



solution 1 : 

t : 0.00000000000000E+00 
m : 1 

the solution for t : 
sll : 4.68750000000000e-02 
sl2 : 1.95312500000000e-03 
s21 : 7.50000000000000e-01 
s22 : 1.25000000000000e-01 
s31 : 1.87500000000000e-01 
s32 : 1.56250000000000e-02 

== err : 0.000E+00 = rco : 

solution 2 : 

t : 0.00000000000000E+00 
m : 1 

the solution for t : 



0.00000000000000E+00 



. 00000000000000E+00 
. 00000000000000E+00 
. 00000000000000E+00 
. 00000000000000E+00 
. 00000000000000E+00 
. 00000000000000E+00 
1.000E+00 = res : 0.000E+00 

0.00000000000000E+00 



sll 
sl2 
s21 
s22 
s31 
s32 
== err 



2.18750000000000e-01 
2 . 34375000000000e-02 
1 . 31250000000000e+00 
-1 . 56250000000000e-01 
4.16666666666667e-01 
-4. 16666666666667e-02 
: 0.000E+00 = rco : 



. 00000000000000E+00 
. 00000000000000E+00 
. 00000000000000E+00 
. 00000000000000E+00 
. 00000000000000E+00 
. 00000000000000E+00 
1.000E+00 = res : 0.000E+00 



The first line indicates that the file contains 10 solutions in 6 unknowns. Here t 
denotes the homotopy parameter, and m denotes the multiplicity of each root. A 
line such as 



sll 



4 . 68750000000000e-02 . 00000000000000E+00 



indicates that at this solution, the variable sll has real part .046875 and imaginary 
part 0. The lines 
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the solution for t : 

and 

== err : 0.000E+00 = rco : 1.000E+00 = res : 0.000E+00 == 

are lines that would have been included by PHC if it had written this solution file 
itself, so we include them also even if we didn't use PHC to generate these solutions. 

Finally, we write an input file gameof 3x3x3_phc with an example of another 
polynomial system of the same shape, which we would like to solve: 

6 

1 - 2*sll + 3*sl2 - 5*s21 + 7*s22 

- 7*sll*s21 - 5*sll*s22 - 3*sl2*s21 + 2*sl2*s22; 
7 - 3*sll - 5*sl2 + 2*s21 - 3*s22 

- 7*sll*s21 + 3*sll*s22 + sl2*s21 - sl2*s22; 
3 - 5*sll - 3*sl2 - 2*s31 + 2*s32 

+ 5*sll*s31 + 7*sll*s32 - 7*sl2*s31 + sl2*s32; 

2 - 3*sll - 5*sl2 - 7*s31 + 7*s32 

+ 5*sll*s31 + 3*sll*s32 - 2*sl2*s31 - sl2*s32; 
1 - 2*s21 - 3*s22 + 7*s31 - 5*s32 

- s21*s31 + 2*s21*s32 + 5*s22*s31 + 3*s22*s32; 
1 - s21 + 2*s22 - 3*s31 - 5*s32 

+ 7*s21*s31 - 2*s21*s32 + 5*s22*s31 + 3*s22*s32; 

Now we can invoke PHC with the -p option, indicating that we already have a 
starting system and its solutions. 

$ phc -p 

Welcome to PHC (Polynomial Homotopy Continuation) V2.3.16 25 Nov 2006 
Polynomial Continuation defined by a homotopy in one parameter. 

Reading the target polynomial system. . . 

Give a string of characters : gameof 3x3x3_phc 

Reading the name of the output file. 

Give a string of characters : gameof 3x3x3_phc . output 

Do you want the solutions on separate file ? (y/n) y 
Reading the name of the file to write the solutions on. 
Give a string of characters : gameof 3x3x3_phc . roots 

Reading the name of the file for start system. 
Give a string of characters : gameof 3x3x3_start_phc 

Reading the name of the file for the solutions. 

Give a string of characters : gameof 3x3x3_start_phc . roots 

Homotopy is H(x,t) = a*(l-t)~k * Q(x) + t~k * P(x) = 0, t in [0,1], 
with Q(x) = a start system, and P(x) = the target system. 

At this point we are presented with several menus allowing us to change different 
options for controlling the homotopy continuation. At each point we can enter 
to accept the default options. Finally we are presented with: 
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No more input expected. See output file for results. 

and, possibly after some delay depending on how big our system is (in this case, 
there is no noticeable delay), the program exits. Now we can look at the solution 
file we specified gameof 3x3x3_phc .roots: 

10 6 



solution 1 : 

t : 1.00000000000000E+00 
m : 1 

the solution for t : 



0.00000000000000E+00 



sll 
sl2 
s21 
s22 
s31 
s32 
== err 



5 . 52632039981343E-01 
-1 . 53240191264371E+00 
9.41581793200150E-02 
4 . 25278257933885E-03 
2 . 32439674939101E-01 
-3 . 51970339164687E-01 
: 8.996E-16 = rco : 



1.29171976073713E+00 
-4 . 25943189689837E-01 
-6 . 89962841355063E-01 
1 . 43036622569914E+00 
4 . 46695512464090E-01 
2 . 04469018836310E-01 
7.083E-02 = res : 7.383E-15 



We see that each component of this solution has a nonzero imaginary part. So this 
solution is not of interest to us. Looking further down in the file, we see another 
solution: 



solution 3 : 

t : 1.00000000000000E+00 
m : 1 

the solution for t : 



0.00000000000000E+00 



sll 
sl2 
s21 
s22 
s31 
s32 
== err 



1 . 27522488578381E+00 
7.45738698011832E-01 
-1 . 04186142941727E-01 
-1 . 12076297688423E+00 
-5 . 09803187724616E-01 
4 . 44045922481355E-01 
: 5.009E-16 = rco 



. 00000000000000E+00 
-3 . 26265223399926E-55 
4 . 07831529249908E-55 
6 . 52530446799852E-55 
-1 . 02304887506437E-55 
-2 . 650904940 12440E-55 
6.629E-02 = res : 3.664E-15 == 

Here the imaginary parts occurring in the various components are very small, and 
could be due to numerical error. The eighth solution is similar. To test our hy- 
pothesis, we make another file gameof 3x3x3_phc . realjroots in which we include 
only these two roots, setting their imaginary parts to zero and renumbering them 
in sequence: 

2 6 



solution 1 : 

t : 1.00000000000000E+00 . 00000000000000E+00 
m : 1 

the solution for t : 



sll 


1 


27522488578381E+00 





00000000000000E+00 


sl2 


7 


45738698011832E-01 





00000000000000E+00 


s21 


-1 


04186142941727E-01 





00000000000000E+00 


s22 


-1 


12076297688423E+00 





00000000000000E+00 


s31 


-5 


09803187724616E-01 





00000000000000E+00 
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s32 : 4.44045922481355E-01 . OOOOOOOOOOOOOOE+00 
== err : 5.009E-16 = rco : 6.629E-02 = res : 3.664E-15 == 
solution 2 : 

t : 1. 00000000000000E+00 . 00000000000000E+00 
m : 1 

the solution for t : 

sll : 6.39293179706243E-02 . 00000000000000E+00 

sl2 : -2.16568143357771E+00 . 00000000000000E+00 

s21 : 4.93650795841189E+01 . 00000000000000E+00 

s22 : -1.96619254862997E+01 . 00000000000000E+00 

s31 : -6.49203588219902E-01 . 00000000000000E+00 

s32 : -1.51339980038990E+00 . 00000000000000E+00 
== err : 2.780E-13 = rco : 1.820E-05 = res : 1.670E-13 == 
Then we ask PHC to validate them by calling it with the -v option: 
$ phc -v 

Welcome to PHC (Polynomial Homotopy Continuation) V2.3.16 25 Nov 2006 
Validation, refinement and purification of computed solution lists. 

MENU with Validation Methods : 

0. Scanning (huge) solution files and creating condition tables; 

1. Basic Validation : refining and weeding out the solution set; 

2. Evaluation of the residuals using multi-precision arithmetic; 

3. Newton's method using multi-precision arithmetic; 

4. Winding-Number Computation by homotopy continuation; 

5. Polyhedral Validation : frequency table of path directions; 

6. Newton's method with deflation for isolated singularities; 

7. Multiplicity structure of isolated singular solutions. 
Type 0, 1, 2, 3, 4, 5, 6, or 7 to select, or i for info : 2 

Is the system on a file ? (y/n/i=info) y 

Reading the name of the input file. 

Give a string of characters : gameof 3x3x3_phc 

Reading the name of the output file. 

Give a string of characters : gameof 3x3x3_phc . validation_of _real_roots 

Reading the name of the file for the solutions. 

Give a string of characters : gameof 3x3x3_phc . real_roots 

Give the number of decimal places : 16 

In this case we chose to evaluate each polynomial system at our candidate roots, 

obtaining the residuals (the magnitudes of their images, which were supposed to 

vanish). Wc look in the file gameof 3x3x3_phc . validation_of jrealjroots for the 

section beginning THE RESIDUALS: 

THE RESIDUALS with 16 decimal places : 

residual 1 : 1 . 2838672747E-14 



FINDING ALL NASH EQUILIBRIA OF A FINITE GAME USING POLYNOMIAL ALGEBRA31 

residual 2 : 6 . 530598545E-13 

So we suspect that these roots are indeed real. Since they do not satisfy the 
nonnegativity constraints, they are not Nash equilibria. (Note well that even if all 
the components of a given solution were real and nonnegative, we would still have 
to check that sll + si 2 <= 1, s21 + s22 <= 1, and s31 + s32 <= 1.) 

Thus, we can compute a library of starting systems for games of various formats. 
This initial computation may take a long time (indeed, computing the permanent 
is iVP-hard), but only has to be done once (or a few times) for games of each 
format. Once we have done this, for any given game, we can look in the library for 
an appropriate starting system along with its roots, parcel out the roots among the 
processors we are using (possibly according to some heuristic scheme if we believe 
some of them are more likely to lead to Nash equilibria), and hand the starting 
system, the desired system, and the subset of roots to each processor. 

If we wish, we can use interval computation along the path to each root to get 
a verified bound on where the final root is. However, interval techniques become 
computationally expensive in higher dimensions. For example, in D dimensions an 
"interval" might be a box with 2 D corners. 

8. Solving Polynomial Systems Using Grobner Bases 

Recall that monomials correspond to points of the lattice N" . A monomial order is 
a total order < of N™, such that for any a, 0, 7 £ N™, if a < /3 then a + 7 < f3 + 7. 
In other words, a monomial order is a total order which is compatible with addition 
of the points in N n , which corresponds to multiplication of monomials. 

An example of a monomial order is the lexicographic order, which is defined as 
follows. First define some ordering on the variables, e.g., x n ^ x n ~i ^ • • • ^ xi d? 
x\. Then the lexicographic order can be defined recursively on the number n of 
variables: x" 71 ^ x^ if and only if a < j3, and x^x^ 2 • ■ ■ x" n ^ x^x^ 2 ■ • ■ if 
and only if either ot\ < (3i, or a\ = (3\ and x 1 ^ 2 ■ ■ ■ x%" ^ x^ 2 ■ ■ ■ x^ n . 

Suppose we are given two polynomials in n variables, f\ (x± , . . . , x n ) and ji {x\ , . . . , 
The set of monomials occurring with nonzero coefficients in /, is the support Ai for 
each i. (Recall that the Newton polytope is the convex hull of the corresponding 
lattice points.) Using the lexicographic order, we can write the elements of Ai in a 
unique way as mio,mn, . . . ,771^ such that to^o -< vn%\ -< • ■ ■ -< Then we can 

write the polynomial equations as 

/i(.ti, . . .,x n ) = a n m ljl H h aiTOn + a Q mi 

and 

/ 2 (xi, . . . , x n ) = h n m 2n -\ h bimu + b m w . 

Here m\j 1 is called the leading monomial of fi, aj 1 mij 1 is called the leading term 
of /1, and aj t is called the leading coefficient of /1, and similarly for f 2 . 

Now that we have a definite order in which to write the monomials, we can 
use long division to divide one polynomial by another. This is very much like 
long division in arithmetic (in fact, in a sense, it's easier, since there's nothing 
to guess). Suppose mij 1 = x^x^ 2 •••x% n and m,2j 2 — x^x^ 2 ■■■x^ n . To divide 
fi by fi, we would write f\ and underneath it a,j 1 bJ 2 1 x" 1 ~ ,3l X2 2 ~~^ 2 ■ ■ • x^™" 13 ™ fi- 
When this is not a proper polynomial because f3j > ctj for some j, i.e., the mono- 
mial mij 2 does not divide m\j 1 , we're already done: the quotient is and the 
remainder is fi itself. Otherwise, we subtract this from fi and write a term 
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a jl 6~ 1 a;" 1_,3l a;2 2-/32 • • • x"" - ^" in the quotient. The leading term of f\ cancels 
out, and the leading monomial of the difference is strictly smaller. Then we repeat 
this process again on this result, adding another term to the quotient, until either 
we can't use the leading term of /2 to cancel the leading term of the result, or the 
result is zero. Then this last difference is the remainder, and we have written down 
all of the quotient. The process has to terminate because the leading monomials 
keep getting smaller and smaller. 

Suppose that the two polynomial equations fx(xx, . . . ,x n ) = and f2(x±, . . . ,x n ) 
i ) hold. From these two polynomial equations we can derive some more polyno- 
mial equations which are logical consequences of them. Let 7, = max(oj, /?s) for 
i = 1, . . . , n, and write 7 = (71, . . . , j„). Since aj 1 7^ and bj 1 ^ 0, we have the 
following equation: 

«7>?" ai 4 2_Q2 • ■■< n - an fi - b^xf-^xf-^ ■ --xl^h = 0. 
Alternatively, we could use instead the equation 

h- T 7i-«i„7a-aa . _7n-a!*i f._„. _7i-^i_72-ft . T 7»-an f _ n 

which does not require that a,j 1 ^ or bj 2 ^ 0. We have chosen the polynomials 
with which to multiply f\ and ji in order to cancel the leading terms of /1 and 
ji- This polynomial is called the S -polynomial S(fx,f2) of f\ and f%. Clearly 
S{fx,h){xx, . . .,x n ) = also. 

Now we can divide S^/i,/^) by /1, getting an equation S(/i,/2) = 51/1 + r\ 
for polynomials q\ and r\, and then divide r% by /2, getting n = 92/2 + fi for 
polynomials (72 and f^. (It is unfortunately the case that the final remainder r-i 
depends on the order in which we divided by fi and /2.) We have that r2 = 
S(fi, fi) — Qxfi — 92/2, so in particular, ^(xi, . . . , x n ) = 0. Thus, if T2 is nonzero, 
we have a logical consequence of our polynomial equations, and we can throw it 
into our polynomial system. Our polynomial system is now {/1, /2, r^}. 

Now if we repeat the process, taking S'-polynomials of pairs of polynomials in 
our new system and dividing each S-polynomial by all the polynomials in our new 
system, we may find more polynomial equations to throw into the system. It is 
a fact from commutative algebra that this process, called Buchberger's algorithm, 
will always terminate (i.e., finally all the remainders will be zero), and the (finite) 
system we have at the end is called a Grobner basis. 

Grobner bases have many nice properties, but what will be important to us for 
solving polynomial systems is elimination theory. If we compute a Grobner basis 
of a polynomial system in the lexicographic order with x n < x n —i ^ • •• ^ %i, 
then those elements of the Grobner basis involving only x n will tell us exactly what 
polynomial equations in x n alone which are logical consequences of the polynomial 
system. We can find the roots (if we prefer, only the real roots) of a polynomial 
equation in one variable, which gives us the possible values of x n . Those elements 
of the Grobner basis involving only x n -\ and x n will tell us exactly the polynomial 
equations in x n -i and x n which arc the logical consequences of the polynomial 
system. Wc can substitute in the possible values of x n we got before, to get the 
possible alternative polynomial equations that x n -\ alone could satisfy. Thus we 
can get the possible values of [x n -\, x n ). Continuing in this way, we can get all the 
possible values of (xi, ... ,x n ). If the system is positive-dimensional, we won't be 
able to do this n times. But the generic finiteness theorem of Harsanyi [11] tells 
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us that a generic game has a finite number of Nash equilibria, i.e., the associated 
polynomial systems are zero-dimensional. 

Let's use the software package Singular jTU] to compute the Grobner basis of a 
game of 3 players with 2 pure strategies each. 

~$ Singular 

SINGULAR / 
A Computer Algebra System for Polynomial Computations / version 3-0-2 

0< 

by: G.-M. Greuel, G. Pfister, H. Schoenemann \ July 2006 

FB Mathematik der Universitaet , D-67653 Kaiserslautern \ 

> ring R=(0,ull00,ull01,ulll0,ullll,u2010,u2011,u2110,u2111 J 
. u3001,u3011,u310l,u3111) , (slO , s20 , s30 , sll , s21 , s31) ,lp; 

Here the second parenthesized expression gives the unknowns. As before we write 
slO for (Jio and so forth. In the first parenthesized expression, the first element 
denotes the characteristic of the ring. To compute over the rational numbers Q 
we set the characteristic to 0. The rest of the elements denote parameters. In this 
case, the parameter ulijk denotes ui(su, S2j , s^k) — ui(s\o, S2j, S3fc), the parameter 
u2ijk denotes U2(su, S2j , s^k) — U2(s±i, S20, S3k), and so forth. Finally, lp means to 
use the lexicographic order. 

Next we specify our polynomial system: 

> poly gl=ull00*s20*s30+ull01*s20*s31+ulll0*s21*s30+ullll*s21*s31 ; 

> poly g2=u2010*sl0*s30+u2011*sl0*s31+u2110*sll*s30+u2111*sll*s31 ; 

> poly g3=u3001*sl0*s20+u3011*sl0*s21+u3101*sll*s20+u3111*sll*s21 ; 

> poly g4=sl0+sll-l; 

> poly g5=s20+s21-l ; 

> poly g6=s30+s31-l ; 

Finally we ask Singular to compute a Grobner basis: 

> ideal G=gl ) g2 ) g3 ) g4 ) g5,g6; 

> G = groebner(G); 

We ask Singular to display the Grobner basis it computed: 

> G; 

G[l]=s30+s31-l 
G[2]=s20+s21-l 
G[3]=sl0+sll-l 

G[4]=(ull00*u2011*u3101-ull00*u2011*u3111-ull00*u2111*u3001+ 

Ull00*u2111*u3011-ull01*u2010*u3101+ull01*u2010*u3111+ 

Ull01*u2110*u3001-ull01*u2110*u3011-ulll0*u2011*u3101+ 

Ulll0*u2011*u3111+ulll0*u2111*u3001-ulll0*u2111*u3011+ 

Ullll*u2010*u3101-ullll*u2010*u3111-ullll*u2110*u3001+ 

ullll*u2110*u3011)*s21+ 

(Ull00*u2010*u3111-ull00*u2011*u3111-ull00*u2110*u3011+ 

Ull00*u2111*u3011-ull01*u2010*u3111+ull01*u2011*u3111+ 

Ull01*u2110*u3011-ull01*u2111*u3011-ulll0*u2010*u3101+ 

Ulll0*u2011*u3101+ulll0*u2110*u3001-ulll0*u2111*u3001+ 

Ullll*u2010*u3101-ullll*u2011*u3101-ullll*u2110*u3001+ 

ullll*u2111*u3001)*s31+ 
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(-Ull00*u2010*u3111-ull00*u2011*u3101+ull00*u2011*u3111+ 
Ull00*u2110*u3011+ull00*u2111*u3001-ull00*u2111*u3011+ 
Ull01*u2010*u3101-ull01*u2110*u3001+ulll0*u2010*u3101- 
Ulll0*u2110*u3001-ullll*u2010*u3101+ullll*u2110*u3001) 

G[5]=(-ull00*u2011*u3011+ull00*u2011*u3111+ull00*u2111*u3011- 

Ull00*u2111*u3111+ull01*u2010*u3011-ull01*u2010*u3111- 

Ull01*u2110*u3011+ull01*u2110*u3111+ulll0*u2011*u3001- 

Ulll0*u2011*u3101-ulll0*u2111*u3001+ulll0*u2111*u3101- 

Ullll*u2010*u3001+ullll*u2010*u3101+ullll*u2110*u3001- 

ullll*u2110*u3101)*sll+ 

(-Ull00*u2010*u3001+ull00*u2010*u3011+ull00*u2011*u3001- 

Ull00*u2011*u3011+ull00*u2110*u3001-ull00*u2110*u3011- 

Ull00*u2111*u3001+ull00*u2111*u3011+ull01*u2010*u3001- 

Ull01*u2010*u3011-ull01*u2011*u3001+ull01*u2011*u3011- 

Ull01*u2110*u3001+ull01*u2110*u3011+ull01*u2111*u3001- 

Ull01*u2111*u3011+ulll0*u2010*u3001-ulll0*u2010*u3011- 

Ulll0*u2011*u3001+ulll0*u2011*u3011-ulll0*u2110*u3001+ 

Ulll0*u2110*u3011+ulll0*u2111*u3001-ulll0*u2111*u3011- 

Ullll*u2010*u3001+ullll*u2010*u3011+ullll*u2011*u3001- 

Ullll*u2011*u3011+ullll*u2110*u3001-ullll*u2110*u3011- 

Ullll*u2111*u3001+ullll*u2111*u3011)*s21*s31+ 

(Ull00*u2010*u3001-ull00*u2010*u3011-ull00*u2011*u3001+ 

Ull00*u2011*u3011-ull00*u2110*u3001+ull00*u2110*u3011+ 

Ull00*u2111*u3001-ull00*u2111*u3011-ulll0*u2010*u3001+ 

Ulll0*u2010*u3011+ulll0*u2011*u3001-ulll0*u2011*u3011+ 

Ulll0*u2110*u3001-ulll0*u2110*u3011-ulll0*u2111*u3001+ 

Ulll0*u2111*u3011)*s21+ 

(Ull00*u2010*u3001-ull00*u2010*u3011+ull00*u2010*u3111- 

Ull00*u2011*u3001+ull00*u2011*u3011-ull00*u2011*u3111- 

Ull00*u2110*u3001+ull00*u2111*u3001-ull01*u2010*u3001+ 

Ull01*u2010*u3011-ull01*u2010*u3111+ull01*u2011*u3001- 

Ull01*u2011*u3011+ull01*u2011*u3111+ull01*u2110*u3001- 

Ull01*u2111*u3001-ulll0*u2010*u3101+ulll0*u2011*u3101+ 

Ulll0*u2110*u3001-ulll0*u2111*u3001+ullll*u2010*u3101- 

Ullll*u2011*u3101-ullll*u2110*u3001+ullll*u2111*u3001)*s31+ 

(-Ull00*u2010*u3001+ull00*u2010*u3011-ull00*u2010*u3111+ 

Ull00*u2011*u3001+ull00*u2110*u3001-ull00*u2111*u3001- 

Ull01*u2010*u3011+ull01*u2010*u3111+ulll0*u2010*u3101- 

Ulll0*u2011*u3001-ulll0*u2110*u3001+ulll0*u2111*u3001+ 

Ullll*u2010*u3001-ullll*u2010*u3101) 

G[6]=(-ull00*u2010*u3111+ull00*u2011*u3111+ 

Ull00*u2110*u3011-ull00*u2111*u3011+ull01*u2010*u3111- 

Ull01*u2011*u3111-ull01*u2110*u3011+ull01*u2111*u3011+ 

Ulll0*u2010*u3101-ulll0*u2011*u3101-ulll0*u2110*u3001+ 

Ulll0*u2111*u3001-ullll*u2010*u3101+ullll*u2011*u3101+ 

ullll*u2110*u3001-ullll=m2111*u3001)*s31~2+ 
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(2*ull00*u2010*u3111-ull00*u2011*u3111- 

2*ull00*u2110*u3011+ull00*u2111*u3011-ull01*u2010*u3111+ 
Ull01*u2110*u3011-2*ulll0*u2010*u3101+ulll0*u2011*u3101+ 
2*ulll0*u2110*u3001-ulll0*u2111*u3001+ullll*u2010*u3101- 
ullll*u2110*u3001)*s31+ 

(-Ull00*u2010*u3111+ull00*u2110*u3011+ulll0*u2010*u3101- 
ulll0*u2110*u3001) 

(We have reformatted the output.) The Grobner basis has 6 elements. The first 
three elements tell us how to find slO in terms of sll, s20 in terms of s21, and 
s30 in terms of s31. The last element G[6] is a quadratic polynomial in s31 alone. 
We can solve this equation to find the possible values of s31. The fourth element 
G[4] tells us how to obtain s21 once we have s31, and the fifth element G[5] tells 
us how to obtain sll once we have s31 and s21. 

Any particular 2x2x2 game is specified by particular values of the parameters, so 
we can just substitute them in and solve the resulting system. Having the Grobner 
basis gives us important information about how the geometry of the solution set 
varies with the parameters. For instance, if the coefficient of s31 2 in G [6] vanishes, 
then this polynomial only has degree 1 and hence only one real root. We can 
consider the discriminant of the quadratic equation G [6] . Writing u l s = Ui (stj , S-i) , 
the discriminant becomes: 

^2u WQ u Q1Q u'l 11 — w 100 u 011 Wm — 2ii 100 w 110 itQ 1:L + Wioo^m^on 

— U 101 U 010 M 111 + ""lOl^llO^Oll — 2Miio u C)lo' lt 101 + U 110 U 011 U 101 + 
2 U 110 U 110 U 001 ~~ u 110 u lll' u 001 + u lll u 010 u 101 — ""lll^llO^OOl 

— 4 ^— Wioo w oio u in + w ioo u oii M in + M ioo u iio w on — w ioo u in M on + 

u 10l' lt 010' u lll — -U 101 U 011 M 111 ~ ""lOl^llO^Oll + -U 101 U 111 M 011 + 

12 3 123 123,123 

u 110 w 010 u 101 U 110 U 011 M 101 M 110 u 110 u 001 ' U 110 U 111 M 001 

^lll^OlO^lOl + ""lll^OH^lOl + ^lll^HO^OOl — "lll^lll^OOl 
^~ U 100 M 010 U 111 + u 100 u 110 u 011 + U 110 M 010 U 101 — ^HO^llO^OOl 

The set of payoff functions where the discriminant is zero is a real algebraic variety 
in the space of 2 x 2 x 2 games, the discrimant variety. It partitions the space 
of 2 x 2 x 2 games into a region where the discriminant is positive, in which case 
the polynomial system has two real roots, and a region where the discriminant is 
negative, in which case the polynomial system has no real roots. 

The reader was already familiar with the discriminant of the quadratic formula, 
but the same phenomenon will happen with equations of higher degrees in more 
variables [9]. In this case there could be several discriminant varieties, with var- 
ious implications about the geometry of the solution set. The SALSA team of 
INRIA Rocquencourt and LIP6 in France has produced a Maple package DV which 
will analyze the discriminant varieties for a parametric polynomial system |16j . 
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and Antonio Montes [20] has independently produced another such Maple pack- 
age DisPGB. (These analyze the implications of the discriminantal equations being 
zero or nonzero for the complex solutions of the polynomial system. In the example 
above, we considered in addition the implications of the discriminant being positive 
or negative on the real solutions.) 

Specifically, Gabriela Jcronimo, Daniel Perrucci, and Juan Sabia have recently 
explained how to obtain a parametric representation of the totally mixed Nash equi- 
libria. (As we know, this means we can get a parametric representation of all the 
Nash equilibria by considering various possible supports.) They give polynomial- 
time algorithms for describing the set of totally mixed Nash equilibria, using mul- 
tihomogeneous resultants. The resultant of a polynomial system is a polynomial 
equation in the coefficients of the system which must hold in order for the system 
to have a root. Resultants are a key tool in the solution of polynomial systems. 
The parametric equations characterize the geometry of the space of games and pro- 
vide an effective method for finding all the roots. We look forward eagerly to the 
implementation of these algorithms in a software package, which we hope will lead 
to many new insights in game theory. 

9. Finding All Nash Equilibria in Gambit 

The Gambit software package incorporates a variety of tools for finding Nash equi- 
libria and studying other properties of games. We will discuss here the version of 
Jaunary 6th, 2006, which was the latest released version at the time of this writing. 

The Gambit source includes a procedure to call the Pelican software for polyhedral 
homotopy continuation which was written by Birk Huber [14j . However, as of this 
release, although Gambit does use homotopy continuation for computing the logistic 
Quantal Response Equilibrium correspondence, as well as the tracing procedures 
mentioned above, it does not use polyhedral homotopy continuation to solve the 
polynomial systems in order to enumerate all Nash equilibria. The Gambit source 
also includes code to solve the polynomial systems by Grobner basis techniques, 
but Gambit does not actually use these either. 

Pelican, written in 1995, is no longer actively maintained, so it's not surprising 
that Gambit doesn't use it. There are now a few other packages for polyhedral 
homotopy continuation, however, and Jan Verschelde continues to actively develop 
PHC in particular. PHC also includes a C interface. Furthermore, the choice of a 
factorizable starting system with manifest roots which we have described here avoids 
the more delicate and computationally complex aspects of polyhedral homotopy 
continuation, leading to an efficient solution method in practice. 

The Gambit Grobner basis code, which was written specifically for Gambit, was 
abandoned due to "numerical instability" . Using Grobner bases for numerical root 
finding is indeed a delicate procedure, since computing a Grobner basis at machine 
precision involves many intermediate multiplication and division operations, which 
makes it difficult to keep errors from accumulating beyond a tolerable level. Of 
course, at the end one also has to find the roots of a univariate polynomial, but 
many carefully written numerical libraries offer routines to do this. The bigger 
problem is that after all the preceding computation to arrive at the Grobner basis, 
the coefficients of the univariate polynomial we're solving may be wrong, giving us 
a root which is wrong; the coefficients of the bivariate polynomial into which we 
substitute the root of the univariate polynomial may also be wrong, giving us a 
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root which is even more wrong; and so forth. It is for these reasons that we too 
recommend Grobner bases for geometric insight into how the structure of the set of 
Nash equilibria may vary over the space of all games of a particular format, rather 
than as a practical tool for finding all the Nash equilibria of one particular game. 
By contrast, homotopy continuation is relatively more mature and well-understood 
as a numerical technique. 

Instead, Gambit solves the polynomial systems defining the Nash equilibria by 
subdividing the product of simplices (where each simplex is the subset of M. di defined 
by en + • • • + <Jidi = 1) &ij > for all j) into small boxes and looking at the Taylor 
series of each polynomial in the system. We can, for instance, evaluate the D 
polynomials (/i, . . . , fjj) at one corner a of such a box, giving a vector (j/i, . . . , yc)- 
Then any point in the box is no further than the diagonally opposite corner, and 
we can plug this distance into the Taylor series of the polynomials about the corner 
to determine a bound on how far the image of any other point a' of the box can lie 
from (j/i, . . . ,dd)- If this bound is less than ||(yi, . . . ,j/£>)|| 2 , then no point in the 
box can be a root of the polynomial system. If it is not, then Gambit looks for a 
root in the box using Newton's method. If such a root is found, then Gambit tries 
to see whether it can determine that no other roots may exist within the box, again 
using the Taylor series of the polynomials. If it can, then it is done with this box, 
but if not, then it subdivides the box into 2 D smaller boxes and looks at those. 

This method has the advantage that it will only find real roots which satisfy the 
nonncgativity constraints. However, it does not scale well with higher dimensions. 
Using polyhedral homotopy continuation with factorizable starting systems, find- 
ing all Nash equilibria of games of much larger formats should become practical. 
However, it may be useful to use a similar Taylor series technique on the augmented 
system (the one including the variable t) along the way to each root of the target 
system, to see whether we can derive a bound ensuring that the target root will not 
be real and nonnegativc (i.e., a Nash equilibrium). In that case we can abandon this 
particular path. Here we are just travelling along a 1-dimensional interval [0, 1], so 
the problem of having to subdivide into an exponential number 2 D of smaller boxes 
does not arise. 

In this release Gambit provide an option to compute Nash equilibria via heuristic 
search on the supports of the game [22j , through an implementation contributed by 
Litao Wei. Heuristic search is complementary to using polynomial algebra to find 
Nash equilibria. It can tell us which of the many possible supports to look at first. 
The choice of support tells us which polynomial systems to solve (possibly none, if 
we find a pure Nash equilibrium on the support and are satisfied with not looking 
any further). 

10. Conclusion 

In this paper we have described the polynomial systems which characterize the 
Nash equilibria of a game. We have explained how to construct and solve a factor- 
izable start system and then use polyhedral homotopy continuation to solve games 
of a given format. We have also explained how to use Grobner bases to gain insight 
into how the geometry of the solution set of these polynomial systems varies over 
the space of games of a particular format. Finally, we have reviewed the current 
use of Gambit for finding all Nash equilibria of a game. We suggest that Gambit 
may be able to find all Nash equilibria of games of larger formats than is currently 
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possible, by incorporating polyhedral homotopy continuation from factorizable non- 
degenerate start systems. Alternatively, or in addition, Gambit may implement the 
algorithm of Jeronimo, Perrucci, and Sabia to find all Nash equilibria of a game. 
We sincerely hope that the possibility of analyzing larger games will enable game 
theorists to make more realistic models of strategic interaction. 
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